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Method of and system for controlling an ambient light and lighting unit 



The invention relates to a method of controlling an ambient ligjit, the method 
comprising receiving a video signal by a receiver; presenting the video signal by a 
presentation device. 

The invention further relates to a system fox controlling an ambient light, the 
5 system comprising receiving means conceived to receive a video signal and translation means 
conceived to translate the video signal iato a displayable signal by a presentation device. 

The invention further relates to a lighting unit comprising a light armature and 

such a system. 

10 An embodiment of such a method and system is generally known from 

television stations that receive a television signal and display received television signal. 
Cable, satellite, etc can receive the television signal. Furthermore, digital video signal 
receivers like set-top boxes are also generally known. These set-top boxes process the 
received digital video signal like an MPEG signal into a signal such as RGB or YUY that can 

15 be displayed by a display unit like a CRT display, a plasma display or a LCD display. The 
display is normally situated in the home, for example in the living room. Here, other furniture 
like a light armature is also present. However, such a light armature is generally adjusted 
manually to emphasize the content of the video signal. For example, when a romantic movie 
is playing, the hghts can be dimmed manually or when a honror movie is playing the colors of 

20 the lights are adjusted manually to comprise red and dark colors. 

It is an object of the invention to provide a method according to the preamble 
that adjusts the ambient light to the content of a media signal in an improved way. To achieve 
this object the method is characterized in that the method further comprises analyzing the 
25 video signal; setting a property of the ambient light based upon the analyzed video signal 
By analyzing a video signal, the ambient light can for example depend upon: the hue, the 
saturation, the brightness, the colors etc. of the video output. The ambient light can also 
depend upon a scene change within the video signal or the speed of scene changes. For 
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example, the ambient light can be switched on and off with each scene change, thereby 
contributing to the experience of a person with the shown video output. 

An embodiment of the method according to the invention is described in claim 

2. By performing face recognition, the content of the video signal as an image is analyzed. 
Depending upon the recognized face, the ambient light can be adjusted. For example, when 
the face of a good character within a movie is recognized, the ambient light uses bright colors 
and when the face of a bad character within a movie is recognized, the ambient light uses 
dark colors. When both a good and bad character are recognized within a mo\de, part of the 
ambient light uses bright colors and an other part of the ambient light uses dark colors, 
thereby creating a mixture of dark and bright colors. 

An embodiment of the method according to the invention is described in claim 

3. By performing expression recognition, the setting of the ambient light can be improved 
further. For example, when a good character is in a bad mood, the ambient light can use dark 
colors or a combination of bright, for the good character, and dark colors, for the bad mood. 

An embodiment of the method according to the invention is described in claim 

4. By presenting the main data by a presentation device and setting the property of the 
ambient light that is in proximity of the presentation device, the ambient light enhances the 
experience of the presented main data more. The experience can be enhanced by, for example 
aUgning the used colors of the ambient light with the average color used within the presented 
main data. The ambient light can, for example, also be aligned with the distribution of the. 
used colors within the presented main data. 

An embodiment of the method according to the invention is described in claim 

5. By setting the property of the ambient light substantially synchronously with presenting 
the main data by the presentation device, the ambient light enhances the experience of the 
presented main data more. For example, in the case of the horror movie, the lights can 
become more dimmed when the tension within the movie increases and can become brighter 
again when the tension within the movie decreases again. The used colors of the ambient 
light can also change according to the changing content of the main data. For example, when 
commercials are shown during a movie, the ambient light can be tumed to normal, white 
light conditions. 

An embodiment of the method according to tlie invention is described in claim 

6. By making the setting of the property of the ambient light configurable, it is possible to 
overrule the default behavior of the ambient light. For example, when an ambient light does 
only support a limited number of colors, the supported colors can be configured. 
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An einbodiment of the method according to the invention is described in claim 
7. By making the setting the property of the ambient h^t configurable by a user preference, 
it is possible to overnile the default behavior of the ambient light further. For example, when 
a user does not desire red ambient light, bright ambient light or a hectic light effect etc., the 
user can configure this preference. 

It is an object of the invention to provide a system according to the preamble 
that reacts upon the actual content of a media signal in an improved way. To achieve this 
object the system is characterized in that the system fijrther comprises: processing means 
conceived to analyze the received video signal and set a property of the ambient light based 
upon the analyzed video signal. 

Embodiments of the system according to the invention are described in claims 
9 and 10. These and other aspects of the invention will be apparent fi-om and elucidated with 
reference to the embodiments described hereinafter as illustrated by the following Figures: 

Figure 1 illustrates an embodiment of an ambient Ught environment; 
Figure 2 illustrates the main steps of an embodiment of the method according 
to the invention; 

Figure 3 illustrates an embodiment of the system according to the invention in 
a schematic way. 

Today, the experience we have while consuming media content at home is 
enhanced by means of bigger screens, image enhancement and more incredible sound. 
Examples of these are wide screen television, 100 Hz. Digital scan image enhancement, 
Dolby Surround Sound, Philips Incredible Sound etc. Moreover, film and Television show 
producers also try to influence the experience of then: audience by all kinds of visual and 
audible effects, such as color, scene cuts, etc. 

Figure 1 illustrates an embodiment of an ambient light environment. Here, 100 
illustrates a living room in which light elements, 102, 104, 106, 108, and 1 12 axe positioned. 
The light elements can comprise LED iUumination cells of different colors like red, green 
and blue. Other colors and other light emitting resources, Uke halogen can also be used. The 
light element 112 is positioned underneath the couch 1 14. The television 110 receives and 
processes a television signal and the processed television is shown on its screen. The 
television 110 can be an analogue television signal receiver or a digital television signal 
receiver. The television signal can be received via a satellite dish, cable, storage device, 
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intemet etc. Furthennore, the television signal can in general be a video signal or an image as 
can be stored upon a VCR, CD, DVD, a Game machine a PC etc. The living room 100 
contains also other furniture like chairs 116, 1 18, and 120 and a table 122. The positions of 
the furniture and the shown fiimiture is only meant as an example to illustrate the invention 
that allows realization and change of both ambiance and light effect in combination with 
video, games, audio, etc. For example, when a person has invited his friends over to watch a 
DVD, the light enhances the experience they have while watching the DVD. In this case, a 
Science Fiction movie is watched and an ambient dark-purple glow amplifies the spooky 
atmosphere of the first scenes. Within the movie, a thunderstorm starts and the ambient light 
flashes synchronous with the thunderstorm lights within the movie. While the thunderstorm 
rolls away, a green pulsating light from beneath the couch starts to indicate that the aliens are 
near the characters within the movie. 

Figure 2 illustrates the main steps of an embodiment of the method according 
to the invention. Within step S200, by means of example, a television signal is received. The 
television signal is a digital television signal The television signal can also be an analogue 
television signal or, instead of a television signal an image signal, like a JPEG image. 

Within step S202, the television signal is analyzed. The television signal can 
be analyzed at various positions in the path of the video signal being presented to the user: 
inside the output device, for example a television set; or using a dedicated device on a scart 
that is running between a television set and a DVD player. Within the analysis, a signal is 
analyzed, like calculating the average color for the received video signal. The average color 
is calculated per image frame that is to be displayed by a displaying device like a television 
screen. Instead of calculating the average color, the most prominent color, the color at the 
comers of the image frame, etc. can be calculated too. As a consequence the calculated color 
can be used to set the hght of the light elements to adopt this color to enhance the ambiance. 
For example, setting a green ambiance light in the surroundings of the display device in the 
case that a documentary about the rain forest is presented or to an ambient light that reflects a 
setting sun and extends the colors of the setting sun across the living room, hi the case fliat 
the comers of the image frame are used to detenuine the color, the Hght elements that are at 
the comer of the display device can take over the color of the comers. Furthermore, the 
distribution of the color over the image can be used to determine the ambient light effect. For 
example, if the light is present in the image frame or in consecutive image frames such that 
the light seems to come either from the left, right or from behind the viewer, then the light 
elements subsequently at the left, right or the back should be more bright. Thus, the 
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determined color setting can influence ambient light settings like hue, saturation, intensity, 
brightness, focus, diffuseness, direction, etc. of the light element. Optionally, these light 
element settings can be fine-tuned within the next steps. 

Within step S204, the image frame is further analyzed for objects that can be 
recognized, for example, a ball, a person or a face. The presence of the objects in the video 
signal is used to further enhance the settings of the ambient light. In the case that a face is 
recognized, the facial expression can be analyzed too. This facial expression is then used to 
enhance the mood of the movie by ambient light settings. For example, when there are a lot 
of bright colors present within a scene, because it reflects a sunny day, but the characters 
playing within the scene are engaged in a fight, the ambient light does also reflect the fi^t by 
dark colors. 

Within step S206, the configuration of the ambient hght environment is taken 
into account to determine the light element settings. The configuration can comprise for 
example, the position of the light elements, the available colors, the available orientations of 
die light elements, etc. The position of the light elements can be used to determine the 
position of the light elements with respect to the display device 1 10. The light elements that 
are very close to the display device 1 10, should not be so bright to prevent that the displayed 
images cannot be viewed properly anymore. Whereas light elements that are too far away 
from the display device 110 should not be used, since their luminance does not contribute to 
the ambient li^t. The position can also be used for example to determine the hght elements 
that should be involved in creating a desired lighting effect. The configuration information 
can further be used to determine the different intensities and colors of the different light 
elements in order to achieve an optimal effect of the combined Ught sources. For example, in 
the case of a specific program, like a health program or sports program that is being shown 
on the display device, a combination of colors can be used that influences health and mood 
like: 



good morning: R 99% + G 99% + B 99% 

relax; R 20% + G 50% + B 80% 

energy: R 99% + q 40% + B 0% 

working: R 60% + G 50% + B 50%» 

idea: R 40% + G 60% + B 0% 

balance: R 40% + G 0% + B 99% 

relation: R 40% -f G 99% + B 50% 



wo 2004/006570 PCT/I B2003/(H»2875 

6 

play: R 99% + G 0% + B 99% 

love: R 99% + G 0% + B 0% 

dream: R 0% + G 0% + B 99% 



in which R stands for Red, G stands for Green and B stands for Blue. Another example is 
configuring the sensitivity for changes in the content. Many scene cuts might result in a 
hectic hghting effect. By lowering the sensitivity, the system only reacts to more major 
changes over a longer period of time. For example, in the case that a DVD or VCR movie is 
viewed, fast forwarding the scenes transits the hghting into a neutral Ught setting. Yet another 
example is configuring the balance, which in the case of multiple Kght soiu-ces would shift 
the lighting more to a specific light source. Also polarization and scene contrast are 
examples, where polarization reflects the ability of the system to enhance the ambiance more 
or less for predefined events, like emphasizing a goal of a favorite soccer club more than a 
goal of the non-favorite soccer club. And scene contrast reflects the ability of the system to 
change the ambient light in succeeding scenes, etc. 

Within the next step S208, other preferences of light settings like user 
preferences are taken into account. These preferences can be used to effect the intensity of 
the ampHfication by the lighting effect of the mood and ambiance of the content. The 
preferences can intensify or weaken the lighting effect, for example to make a scary movie 
appear less frightening. The user preferences can also be used to determine if a user has 
aheady seen a movie. For example, the ambient light effects can intensify each tune a user 
has watched a movie. Furthermore, the user preferences can be used to detennine the desired 
lighting effects, like for example when a user does not want a thunderstorm to be 
emphasized, the lighting effects for a thunderstorm can be omitted. 

Within the final step S210, the light settings are transmitted to the different 
Ught elements while synchronously the television signal is displayed by the display device. 
Generally, together with displaying the television signal, audio is played as well. Preferably, 
the lighting effect is synchronized both with the displayed television signal and the audio 
signal. Because the audio signal can be played with surround effects, as is generally known, 
the lighting effect is further preferably synchronized with the audio in terms of both space 
and time. For instance, a sound explosion behind the viewer at the right hand side, should be 
supported by a light effect emitted by the light elements that are positioned at the right hand 
side too. 
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With the described method amongst others, a following effect can be 
achieved: consider a science fiction movie in which an alien ship cast a shadow over a city. 
This is enhanced by extending this movement with ambient light. If the ship starts behind the 
viewer, the two light elements in the back dim first. Subsequently the sub light and the light 
elements in the front dim and finally the ship can be soon moving over the city on the 
television screen. If the ship starts in the screen and moves forward over the viewer, the two 
light elements in the front dim jfirst, and subsequently the sub light and the light elements in 
the back dim. Finally the frontal light elements, the sub light and the back light elements 
brighten again so that it seems that the ship continues flying. 

The order in the described embodiments of the method of the current invention 
is not mandatory, a person skilled in the art may change the order of steps or perform steps 
concurrently using threading models, multi-processor systems or multiple processes without 
departing from the concept as intended by the current invention. 

Figure 3 illustrates an embodiment of the system according to the invention in 
a schematic way. The system 300 comprises memories 302, 304, 308, and 310. Memory 302 
comprises computer readable code designed to receive and decode a digital video signal like 
an MPEG signal. Memory 304 comprises computer readable code designed to analyze the 
digital video signal for patterns and objects and to set the light settings of the light elements 
3 14 and 316 depending thereupon as previously described. Light element 314 comprises one 
halogen light source and ligjit element 316 is a LED light and comprises three hght sources: 
Red, Green and Blue. Memory 308 comprises computer readable code designed to 
synchronize the received video signal with the light settings. Memory 310 comprises 
computer readable code designed to translate the video signal into a displayable signal like 
RGB for the display 312, like a CRT. The memories can communicate with each other 
through a software bus while using the processing power of a central processing unit, both of 
which are not shown. The system is described by means of example as a software system. 
However, dedicated hardware or combinations of software with hardware, like programmable 
hardware that is designed to perform the mentioned method steps is included too. 
Furthermore, a digital video signal is used as an example, while an analogue video signal can 
be used too. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. For example, 
extending the lighting with more, specific purpose, light sources and offering algorithms to 
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hannonize the output of these sources, like using a floodlight to enlighten a wall for the 
purpose of ambiance creation, spots that are positioned on various locations for the puiposp 
of lighting effects in specific locations in the room, or a sub light positioned under a couch. 
In the claims, any reference signs placed between parentheses shall not be construed as 
5 limiting the claim. The word "comprising" does not exclude the presence of elements or steps 
other than those Usted in a claim. The word "a" or "an" preceding a element does not exclude 
the presence of a plurality of such elements. The invention can be implemented by means of 
hardware comprising several distinct elements, and by means of a suitably programmed 
computer. In the system claims enumerating several means, several of these means can be 
10 embodied by one and the same item of computer readable software or hardware. The mere 
fact that certain measures ai-e recited in mutually different dependent claims does not indicate 
that a combination of these measures cannot be used to advantage. 



